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Experimentation in education, however desirable, must, in the 
nature of the case and in the interests of its subjects, be muchmore 
limited in amount and scope than in the natural sciences and even 
in some other of the social sciences. It is for this reason the more 
necessary that present practices and methods now in use in educa- 
tion be evaluated before changes are made in them or they are 
replaced by others. Present practices, until they have been tested 
and their effects known, as far as that is possible, should be regarded 
as nothing but great educational experiments. Only in this way 
can we have any real guaranty that the new in education is any 
better than the old. 

Since the effects of educational practices can seldom be estimated 
by the results in any one case but only from the results in large 
groups of cases, they involve statistical procedures for their proper 
understanding and evaluation. Statistics is a science of making 
numbers intelligible. Unfortunately, it frequently produces the 
opposite effect. Many of us pass over columns of figures and 
statistical computations as gladly and with as few compunctions as 
we do the descriptions of natural scenery which interrupt the plot 

1 Read at the meeting of the Harvard Teachers Association, Cambridge, 
Massachusetts, March 15, 1913. 
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of an exciting novel. But whatever our prejudices, it must be 
recognized that the necessary statistical studies of school work have 
been all too few and that in our office and classroom records there 
is not a little material, the proper study of which would furnish a 
basis for discriminating judgments of the value of past and present 
practices in education. 

I wish to call attention to one group of such studies on the 
relations of schools and colleges. 

College authorities usually estimate, in a general way, the 
efficiency of high schools and academies on the basis of the prepara- 
tion and attainments of the pupils who come to them from these 
schools and, in their turn, the high-school principals have been 
rating the elementary schools in terms of the success or failure of 
the elementary pupils in the high-school classes. With the decreas- 
ing importance of the entrance examinations and the extension of 
methods of certification and accreditation of schools, these judg- 
ments passed by one institution upon another have assumed 
considerable importance. The principle of these comparisons, 
namely the rating of a school on the basis of the relative standing 
taken by its pupils in a second institution, is, it is believed by the 
writer, a sound one and may lead to reliable conclusions. The 
methods and ways in which this principle is ordinarily made use of 
are, however, frequently crude and incomplete and lead to indi- 
vidual opinions rather than to reliable evidence. 

These methods may not only be made much more accurate and 
trustworthy but are susceptible of much further extension. By 
their use it is not only possible for higher schools to accredit the 
lower schools justly, but it is also possible for the lower schools to 
pass reliable judgments on the quality of work in the higher institu- 
tions. As an illustration of this last statement, a condition may be 
cited that has been met with in these studies. The graduates of a 
certain academy have, for a period of many years, gone in large 
numbers to two colleges. At one of these colleges, even the lowest 
ranking pupils from the academy are admitted and take satisfac- 
tory standing. At the other college, only the best of the academy's 
graduates find admission, and frequently they take no more than 
average standing in their college work. This condition is sub- 
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stantiated by other high schools and academies which send pupils 
to these two colleges and should be sufficient to raise a strong 
presumption that the standard of work in one of these colleges is 
very much inferior to that of the other college. 

Comparisons such as this, on the basis of the character and 
attainments of the same or comparable groups of students in two or 
more different institutions, may therefore not only furnish facts on 
the basis of which the college may evaluate the work of the various 
secondary schools but may often furnish the basis of reliable judg- 
ments by the secondary schools in regard to the character of the 
higher institutions. The latter may be judged, first, by the sort of 
pupils they secure and, secondly, by the way in which they handle 
this product of the secondary schools. A group of high schools may 
thus, through the comparative records which their students make 
in the colleges and higher technical and professional schools, pass 
judgment upon these higher institutions of learning. 

A similar outcome will result from the comparison of high schools 
with elementary schools. High-school teachers criticize freely the 
product of the elementary schools and they do so practically always 
in terms of high-school standards. These contributing elementary 
schools have just as good reason to estimate and control the char- 
acter of work in the high schools in relation to their own standards, 
and they have in the comparative records of their pupils in the high 
schools excellent means of doing so. 

A simple study of this latter sort, which not a few principals in the 
Middle West are now carrying out to advantage in their own schools, 
may be illustrated by the following example. A group of about 100 
students in a small city high school were divided into three divisions 
on the basis of their average rank in the elementary school. The 
question was then asked, "In how far do those students who stood 
in the various thirds — upper, middle, and lower — of their class in 
the elementary school maintain the same relative rank in the high 
school, that is, remain in similar divisions of the high-school class ?" 

The accompanying table answers the question. Of the pupils 
who were in the first third of the elementary school class 81 per cent 
maintain their rank in the first third of the high school, 50 per cent 
who were in the middle third remain there in high school, and 64 
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per cent of those who ranked lowest in the elementary school are 
found to be in the lowest third of the high-school class. On the 
average, then, 65 per cent remain in the same divisions of the high 
school in which they were in the elementary school. Small varia- 
tions which are of no great significance may be neglected by the 
comparison made in the second part of the table (Tertile-Median 
Method) , which shows that 90 per cent of the pupils who were in the 
first third of the elementary school class maintained a position above 
the middle (median) of the high-school class, and 84 per cent of 
those in the lowest third remain below the median of the high-school 



TABLE I 

PERCENTAGES OF RETENTION 



1 Tertile 



2 Tertile 



3 Tertile 



Tertile Method: 
Average .... 
Mathematics 
English 



Percentage 

81 

75 
66 



Percentage 

5° 
51 
40 



Percentage 

64 

78 
S3 



High 



Low 



Tertile-Median Method: 
(Per cent in extreme tertiles not varying 
beyond the median.) 

Average 

Mathematics 

English 



Percentage 



90 

87 
81 



Percentage 



84 
84 
78 



class. By averaging these two percentages, we may express the 
"percentage of retention" of this elementary school in a single 
figure, as 87 per cent. In other words, only about 13 per cent of 
these students differed in rank in high school appreciably from the 
rank which they had attained in the elementary school. 

The comparison has also been made for separate subjects, as 
shown in the table for mathematics and English. The results point 
to a high degree of correlation between the work and standards of 
this particular elementary school and high school. 

The problem is more complex when the comparison is made 
between several elementary schools and high schools in a large city. 
Such a study has been carried out successfully by Mr. Carter in the 
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schools of Milwaukee. His study was made on the basis of one 
year's class of 1,497 pupils from 39 elementary schools. Of these, 
670 or about 45 per cent entered high school. 

There are several features of the study which demand special 
attention. 

One elementary school may send largely its poorest or average 
pupils to the high school; another school may send only its better 
pupils. It is evidently not fair to judge of the merits of the two 
schools by such an unequal sampling of their pupils. 

In general, those who entered high school in this city were but 

little superior in scholarship to those who dropped out of school on 

the completion of the eighth grade. Less than 57 per cent of those 

who remained in school ranked above the middle (median) of their 

class in the elementary school. The same fact may be expressed 

by stating the percentages of those who went on to high school from 

the various thirds of the elementary classes. This is done in the 

first line of the accompanying table on the basis of the averages 

from twenty-five schools, and shows that 27 per cent went to high 

school from the lowest thirds of the elementary school classes, 35 

per cent from the middle thirds, and 38 per cent from the high 

thirds. 

TABLE II 

Percentage of Pupils Entering High School from the Tertiles of Elementary 

School Classes 

(Subject Languages) 





Low Third 


Middle Third 


High Third 


1. Average 25 Schools 


Percentage 
27 


Percentage 
35 


Percentage 
38 




49 
21 


35 

57 


35 
86 









Two schools whose representation differed noticeably from these 
averages are cited by way of illustration in the next two lines of 
the table. From School No. 14 one-half of the poorest pupils (49 
per cent) were sent to high school and one-third of the best (35 per 
cent); from School No. 4 a fifth (21 per cent) of its poorest pupils 
and over four-fifths (86 per cent) of its best pupils went on to high 
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school. If one is tojjudge'of the relative merits of these two schools 
in terms of the performance of their pupils in high school, these 
differences in representation must very evidently be taken account 
of. This has been done by Mr. Carter by means of the following 
scheme of comparison: 
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In the horizontal lines, the pupils are arranged by the thirds of 
the elementary class from which they came; in the three vertical 
columns, the same pupils are classified according to their standing in 
the high-school class. The subjects of comparison are arithmetic 
and algebra. The pupils in the three diagonal squares inclosed by 
heavy lines have not changed their relative position in going from 
the elementary school to high school. The pupils in the three 
squares below the heavy lined squares have advanced; those above 
these squares have regressed in relative standing. 

School 17 sent a group to high school which was above the 
average of the original class, there being more students from the 
upper third than the lower. In the high school, 13 of these pupils 
fell in rank while 6 improved in rank. In other words, a better 
than average group on the basis of elementary school standards 
took less than average standing in the high school — a poor showing 
for the school. 

In School 18, the class originally numbered 28: 18 of these went 
to high school including 7 from the lowest third of the class. Of 
these 18, 7 improved their rank while but 2 were lowered in rank. 
In other words, a very average group from the elementary school, 
including a large representation of the poorest pupils in school, 
made a better than average standing in the high school — a very 
good showing for the school. 

The correlations of standing between the elementary and high 
schools in this city were, on the average, low, as has been shown in 
Table II. Miles found a much higher percentage of relation in a 
study of elementary and high schools in the state of Iowa. His 
results are expressed by the Pearson coefficient of correlation, as 
+71 per cent. The similar coefficient of correlation between 8 
large high schools and the University of Wisconsin was found to be 
+80 per cent. F. O. Smith found a similar degree of relation 
between one high school and the State University of Iowa. 
Expressed in terms of the change of rank about the median, the 
results at Iowa and Wisconsin are in close agreement, about 70 per 
cent of pupils remaining in each case in the respective halves of the 
class in which they stood in the high-school grouping. President 
Lowell has carried the comparison a step farther and has shown that 
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the students who take high rank in college, irrespective of the 
subject-matter of their courses, are the ones who take the superior 
rank in the professional schools of law and medicine. 

Dr. Clement, in a study of a large number of elementary schools, 
high schools, and colleges in the state of Kansas, was the first to 
follow the course of a group of the same students through three 
institutions from the elementary school to the college. Some of his 
results may be roughly summarized by making use of the following 
chart, an adaptation of one suggested by Mr. Carter. 1 



University 
Level 



High School 
Level 
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Elementary c "Z 
School Level O 
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24 






3? 



V 



52 



53 



A pupil starting in any third of the group in the elementary school 
has according to this scheme nine possible paths by which he may 
reach college; he may take rank in either the high, middle, or low 
third of the high-school class, and finish his course in any one of the 
thirds of the college class. With these nine possibilities of fluctu- 
ation, it is interesting to find that in the high third of the class 
over 6o per cent take the straightest course — that is, they go from 
first rank in elementary school to first rank in high school, to first 
rank in university. In the group under study, there are 158 pupils. 

1 In an unpublished study. 
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The number who follow the straight courses are indicated in the 
diagram by continuous lines; those who follow other courses are 
indicated for the middle group by heavy dotted lines. The per- 
centages are given below. 

TABLE IV 
Percentages of Retention (According to Above Chart) 

Elem. school-Colleges 43-4 26.9 60. 4 

High school-Colleges 74.2 54.4 82.1 

Elem. school-High school 58 . 5 46 . 2 73 . 6 



There is really a higher percentage of retention if the beginning 
and end of the course are alone considered. Six pupils, for instance, 
who started in the first third of the elementary class, fell to lower 
thirds in the high school but regained their position in the college, 
giving a final percentage of 74 per cent of those starting in the upper 
third of the elementary-school class, and finishing in the upper third 
of the college class. 

Clements' results may best be expressed in terms of the per- 
centage of pupils in the high and low thirds of the class who do not 
change their relative position sufficiently to cross the middle line of 
the class (Tertile-Median Comparison). These results, as shown in 
the following Table V, indicate that there was between the insti- 
tutions a very high degree of correlation. 

TABLE V 

Percentages of Retention (Tertile-Median Method) 

Grammar School No. 5-High School No. 5-College No. 2 = 70 per cent (go cases) 
Grammar School No. 6-High School No. 6-College No. 3 = 75 per cent (90 cases) 
Grammar School No. i-High School No. i-College No. 1 =85 per cent (158 cases) 

In the light of these results and those summarized above, we may 
conclude that a percentage of retention of 75 per cent expressed in 
terms of the Tertile-Median Method or of the Pearson Coefficient of 
Correlation on the basis of the relative rank maintained by pupils 
in related institutions is an attainable standard. Marked deviation 
from this standard either in the case of separate subjects of study 
or on the basis of the general averages, and either within the same 
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school or between different schools, might well lead to investigations 
of the reasons and causes. 

The consistency of performance from the early to the late years 
of school life in the case of such large groups of students, as is shown 
by these results, is not without significance to the student and 
administrator interested in the possibilities of educational prognosis. 

The results bear also on the more general question of nature 
versus nurture, of the mental differences due to inborn capacity and 
those due to training. Students appear from these studies to 
maintain in surprisingly large numbers from the elementary school 
to the college the relative rank with which they began. The 
diversity of training in school and college is perhaps after all not 
great — the comparison would gain interest, if groups of students 
could be compared whose intermediate training between the early 
years of the elementary school and the college or the professional 
school differed much more than is the case of those students who 
pursue the regular courses and methods of study — but taking the 
results as they stand, they appear to indicate that the changes 
which school training produces are not sufficient to overbalance the 
differences in mental ability which are there to begin with. 

Aside from such bearings as these studies may have upon general 
educational questions, they seem to discover in a very practical way 
maladjustments between schools and departments of study, and 
instances of inharmonious working, and have proved stimulating 
in their effect on the organization and administration of schools. 
This is their chief value. 



